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The 4th Dimension 


The 4th and higher dimensions have been well understood by mathematicians from an analytic point of view. Few in- 
vestigators think of a 4th spatial dimension as real in the same sense that we think of our 3 dimensional world. One exception 
to this point of view is Professor Thomas Banchoff of Brown University. Banchoff has made his life-work the study of the 
topological and geometric properties of 4 and higher dimensional shapes and surfaces. He has used computer graphics to generate 
3-dimensional slices of higher dimensional forms. By studying these 3-d projections, Banchoff gains insight into the higher 
dimensional shape and has actually discovered a large number of new topological and geometric properties by seeing them. 


Although apparently unrelated to statistical methods, Banchoff’s methods, in fact, are closely related. With the advent 
of computerized instrumentation, the collection of multi-attribute (multi-dimensional) data has become commonplace. The 
analysis of multi-attribute data is difficult not only because it is difficult to use graphical methods for data that are more than 
3-dimensional, but also because the standard generalizations of 1-dimensional formulae often prove to be ineffective as analysis 
tools in higher dimensions. Banchoff’s current project for ONR involves close work with statisticians to develop his methods 
to gain insight into high-dimensional statistical data sets. The ORION-1 system discussed elsewhere in this issue is an example 


of a computer graphics tool designed to gain this insight. 


One particularly stunning example of Banchoff’s work is a film entitled, ‘“The Hypercube: Projection and Slices,’’ which 
has won prizes at two international scientific film festivals. In this film, Banchoff and his colleague, Charles Strauss, take 
the viewer through a series of mental steps leading to the 4th dimension. Think of a line, they say—a one-dimensional object 
with two ends of vertices. Then move the line along an axis perpendicular to it to form a square (two dimensions, four ver- 
tices). Move the square in a third perpendicular direction to form a cube (three dimensions, eight vertices). Then think of a mov- 
ing the cube in a fourth dimension perpendicular to the other three to form a hypercube, a four-dimension perpendicular to 
the other eight cubical faces. The information you get depends on the angle you view it from. As it rotates, the inner cube 
appears to move up through the top of the object, flatten, and turn inside out. 
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About Our Cover A very large scale integrated (VLSI) circuit technology will require a 
very high density per chip. Because it will be impossible to design each 
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mathematical challenge is to exploit this array of relatively simple processor 
to carry out a complex task quickly. The array on the front cover is a pro- 
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algebra. (See page 9). 
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Introductory Note 


~ ince its creation in 1946, the Office of Naval 
k_J Research (ONR) has recognized the importance of 
investment in research in the mathematical sciences 
(mathematics, statistics, computer science, operations 
research). This recognition has enabled ONR to be a 
pioneering force in both the development and applica- 
tions of new mathematical concepts. Many of the ad- 
vances in computers and computing, signal process- 
ing, scheduling and logistics can be traced directly to 
research by eminent scientists supported by ONR over 
the last 35 years. Research advances in other fields, 
ranging from management science to radar to laser 
physics, depend partially upon improved analysis 
capabilities, techniques, and algorithms developed 
under ONR support in the mathematical sciences. 
The continuing computer revolution promises to 
increase the already large role that the mathematical 
sciences play in the modern Navy and in our 
technological society. First, increased computational 
speed and reduced costs permit mathematics to be 
utilized, via computation, to an ever widening class 
of applications. Second, increased computational 


capabililty has given scientists the opportunity to ad- 
dress more complex problems using more sophisticated 
mathematical science techniques. Thus, the need for 
mathematical science research has grown in parallel 
with our increased computational capability. 

Given this ubiquitious nature of the mathematical 
sciences, it is clearly impossible to treat prospects for 
mathematical science research fully in this single issue. 
Some of the more complex and difficult areas of 
mathematical research were not appropriate to this 
issue. We have chosen, therefore, four articles which 
illustrate some of the new and challenging areas and 
opportunities which are faced by mathematicians to- 
day in carrying out ONR’s mission of providing 
technological superiority to the U.S. Navy. 

Credit for organizing this issue of Naval Research 
Reviews devoted to mathematical sciences sould be 
given to Dr. J.C.T. Pool, former Division Director of 
the Mathematical Sciences Division. 


Charles J. Holland 
Office of Naval Research 








VLSI chip designed at Carnegie—Mellon 
University with Office of Naval Research funding. 
This chip is an example of the special purpose 
processor designed to implement software in 
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An Introduction to Systolic 
Algorithms and Architectures 


by 


Jon Louis Bentley 
H.T. Kung 
Carnegie-Mellon University 


Introduction 


he design tradeoffs inherent in good engineering 

often imply that there is no single best design for 
solving a given family of tasks. Consider, for instance, 
the task of designing a general-purpose vehicle. An 
F-14 augmented with Phoenix missles is an excellent 
vehicle for the task of establishing air superiority, and 
a ten-speed bicycle augmented with a backpack is an 
excellent vechicle for the task of going to a 
neighborhood grocery to purchase a carton of milk. 
It is hard to imagine a single general-purpose vehicle 
that would do as well at both these tasks as each 
special-purpose vehicle does individually. 

The vast majority of computer users, however, 
do in fact use devices labelled ‘‘general-purpose’’ 
computers. Futhermore, in most task domains, these 
general-purpose devices have been remarkably 
successful. Most computer users do well to work on 
a general-purpose computing device: it offers 
advantages of ease of use and generality that usually 
far outweigh the disadvantages of increased cost and 
decreased performance (as compared to special- 
purpose machines). In some applications, though, the 
cost and performance requirements are so demanding 
that no general-purpose machine can meet them, so 
the computer engineer has no choice but to turn to a 
special-purpose computer to solve his problem. 

In this paper we will survey the class of systolic 
special-purpose computer architectures and 





The term systolic refers to the regular flow of data through the 
machine, which is similar to the rhythmic flow of blood through 
the body caused by the systolic contractions of the heart; this 
definition will be claborated later in the paper. 
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algorithms, which are particularly well-suited for 
implementation in very large scale integrated circuitry 
(VLSI). The principles of systolic algorithms were first 
enunciated by H.T. Kung and Charles Leiserson [1] 
in work supported by the Office of Naval Reserach 
(ONR) at Carnegie-Mellon University in 1978. Since 
that time they have been studied extensively by Kung’s 
research group at Carnegie-Mellon (the basic research 
has been supported by ONR; the development activity 
surrounding the design of prototype chips have been 
funded by the Defense Advanced Research Projects 
Agency (DARPA) and by hundreds of other 
researchers throughout the world (the several dozen 
papers cited at the end of this article represent only 
a small fraction of the technical literature dealing with 
various aspects of systolic arrays). 

This paper is a brief introduction to systolic arrays 
for a reader with a broad technical background and 
some experience in using a computer, but who is not 
neccessarily a computer scientist. Kung [2] provides 
more technical introduction to the subject. In the next 
section we will briefly survey the technological 
advances in VLSI that led to the development of 
systolic algorithms and architectures; this section 
establishes the ground rules underlying the rest of the 
paper. An overview of systolic architectures is given 
in the section entitled ‘‘Systolic Arrays as Special- 
Purpose VLSI Devices.’’ Then in the section, ‘‘An 
Example,’’ we will study in detail one special-purpose 
systolic architecture for efficiently solving a particular 
problem. In the section, ‘‘An Overview of Systolic 
Designs,’’ we will turn to an overview of systolic 
algorithms. The last section discusses future directions. 





VLSI: The Opportunity and the Problem 


The integrated circuitry that revolutionized 
electronics in the 1960’s in now referred to historically 
as SSI: small scale integration. It was followed by MSI 
(medium-scale), LSI (large-scale) and VLSI (very-large 
scale integration). The history and the future of the 
miniaturization underlying the string of names has 
been graphically described in an analogy due to 
Charles Seitz (quoted here from ‘‘About the Cover’’, 
Lambda Magazine, First Quarter, 1980): 

In the mid-1960’s the complexity of a 
chip was comparable to the street network of 

a small town. Most people can navigate such 

a network by memory without difficulty. 

Today’s microprocessor, using a five-micron 

technology, is comparable to the entire San 

Francisco Bay Area. By the time a one-micron 

technology is solidly in place, designing a chip 

will be comparable to planning a street 

network covering all of California and 

Nevada at urban densities. The ultimate one- 

quarter micron technology will likely be 

capable of producing chips with the intricacy 

of an urban grid covering the entire North 

American continent. 

In absolute terms, the largest current chips 
contain almost a million transistors, yet their cost and 
energy consumption is not considerably greater than 
their counterparts of less than two decades ago. 

The technology alone is only part of the good 
news of VLSI; its inherent potential is likely to come 
within the grasp of a new generation of circuit 
designers. At the birth of integrated circuitry, design 
in the medium was a skill limited to a few experts in 
this important (but narrow) art. This was changed 
dramatically by the efforts of Carver Mead and Lynn 
Conway [3], who reduced the practice of VLSI design 
to a small set of engineering principles that is now 
routinely taught in one-semester university courses. 
After such a course, senior computer science 
undergraduates (with little, if any, background in 
electrical engineering) are typically able to design a 
small circuit in VLSI technology. 

The promise of VLSI is not without its challenges, 
though. From a viewpoint of the technology alone, the 
medium presents several new technical challenges. 
Primary among those is a high ‘‘communication cost’’. 
Previous generations of circuit designers have had the 
view that computation is expensive while 
communicating the results of the computation is 
almost free. In VLSI, though, the communication 
costs are high in execution time, power dissipation, and 


chip area [4]. Another technological observation is that 
the switching speed of VLSI circuits is not that much 
greater than the SSI speed of the 1960’s. The most 
important challenge of VLSI, though, goes beyond the 
technology itself to its use: there is an incredibly high 
cost in designing VLSI circuitry. It is not atypical for 
some chips to have a design cost as high as one million 
dollars and a design time of several years. 

To summarize the above, we should keep in mind 
the following two facts. 


e The Potential. VLSI currently offers a huge 
number of transistors on an integrated 
circuit; that number promises to increase 
substantially in the next decade. The large 
number of transistors offers increased 
functionality in digital designs, increased 
memory, and a potential increase in 
computing speed if the logical devices are 
run in parallel. 

The Challenge. To exploit the promise of 
VLSI, a design must’ minimize 
communication and design costs. 
Communication costs are minimized by 
regular structures that communicate over 
short wires; design costs are minimized by 
using regular structures rather than 
designing new components from scratch. 


Systolic Arrays as 
Special-Purpose VLSI Devices 


In this section we will consider various 
approaches to exploiting the opportunity of VLSI 
while respecting its challenges, and then focus on the 
single approach of systolic arrays. The following two 
approaches represent two ends of the VLSI spectrum. 


¢ Further Down Old Paths. We can try to use 
VLSI to make more efficient 
implementations of the traditional von 
Neumann computer architectures. This 
approach has been quite successful for 
systems implemented in non-VLSI 
technology, where communication is not a 
serious issue. It has become apparent in the 
past several years, though, that this 
approach will never be able to exploit fully 
the potential of VLSI due to the ‘‘von 
Neumann bottleneck’’: no matter how 
powerful we make a processor or how large 
and fast our memory, they are still doomed 
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to communicate through a very small, low- 
bandwidth (relative) channel of the 
memory access mechanism. Specifically, if 
we have a powerful processor connected to 
a hundred million words of memory, at 
every particular clock cycle only a few of 
the words in memory can be communicated 
to the processor; the rest of the data will 
be unused. 

Radically New General-Purpose 
Architectures. Several ways around the von 
Nuemann bottleneck have been proposed 
recently by various researchers, as surveyed 
by Treleaven [5]. Although these methods 
do appear promising for the distant future, 
most of them will entail a fundamental 
change in our view of computer hardware 
and software. It is not clear that any of 
these methods will have a substantial 
impact on the practice of software 
engineering in this century. 


Note that these approaches suffer from different flaws: 
the former is too concervative, while the latter is too 
risky. 

Throughout the rest of this paper, we will focus 
on an approach that is midway between the previous 
two: we will keep the standard von Neumann 
architecture for most of the system, but we offload 
the computation-intensive tasks onto special-purpose 
devices that involve a different computational 
structure. For instance, if we find that a certain set 
of matrix computations is in the time bottleneck of 
our system, we can offload those operations onto a 
special matrix processor, while performing the rest of 
the system on the original general-purpose machine. 

There are many approaches to building special- 
purpose computer architectures; the systolic approach 
is characterized by Kung [2] as follows. 


In a systolic system, data flows from the 
computer memory in a rhythmic fashion, 
passing though many processing elements 
before it returns to memory, much as blood 
circulates to and from the heart. The system 
works like an automobile assembly line where 
different people work on the same car at 
different times and many cars are assembled 
simultaneously. An assembly line is always 
linear, however, and systolic systems are 
sometimes two-dimensional. They can be 
rectangular, triangular, or hexagonal to make 
use of high degrees of parallelism. Moreover, 
to implement a variety af computations, data 
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flow in a systolic system may be at multiple 
speeds in multiple directions — both inputs 
and (partial) results flow, whereas only results 
flow in classical pipelined systems. Generally 
speaking, a systolic system is easy to 
implement because of its regularity and easy 
to reconfigure (to meet various outside 
constraints) because of its modularity. 


At this point we can explain the name systolic arrays: 
the regular flow of the data through the processor is 
similar to the rhythmic flow of blood through the 
body, generated by the systolic contractions of the 
heart. 

To make these abstract notions more concrete, we 
will consider an algorithm from everyday life that 
illustrates many of the features of systolic arrays: how 
do we ensure that each of the 200 guests at a wedding 
shakes hands with each of the 15 members of the 
wedding party? A simple approach has a single Master 
of Ceremonies orchestrate each of the 200 x 15 = 3000 
handshakes, and each is performed at a separate time. 
This approach suffers from two fatal flaws. First, the 
job of the Master of Ceremonies involves handling 
massive amounts of data and is hopelessly confusing. 
Second, even the rapid rate of ten seconds per 
handshake would yield a total time for the affair of 
over eight hours. The typical (systolic) organization 
for this task is less difficult to manage and more 
efficient in time; by arranging a receiving line of the 
15 members of the wedding party, and then having the 
200 guests file past the party, all hands can be shaken 
in just a little under forty minutes. 

The pipelining of the receiving line is obviously 
very efficient, and provides a handy analogy for one 
kind of systolic algorithm. The 15 members of the 
wedding party correspond to 15 processors arranged 
in a linear array, and the 200 guests can be viewed as 
data, passing regularly from the input of the receiving 
line to its output (the first and last members of the 
line). The analogy weakens as we consider the 
computation performed in this task; the goal of each 
guest is to collect the 15 handshakes, and each member 
of the party performs the function of providing one 
of the handshakes. This analogy should become clearer 
as we consider in the next section a problem whose 
systolic solution uses the same structure as the receiving 
line. 


An Example 


In this section we will study the following 
problem, which arises in a number of pattern 
recognition applications. 





The Nearest Neighbors Problem. Given 
a set of N training points and a set of M 
sample points, for each sample point 
determine its nearest neighbor among the 
training points. We assume that each point is 
described by k coordinates (that is, the points 
are in k-dimensional space) and that the 
distance between points is the standard 
Euclidean distance. 


For definiteness, we will assume that we are 
solving the particular problem that N=1000, 
M = 20000, and k = 3 (that is, we are searching for the 
nearest neighbors of 20000 points among a set of 1000 
points in Euclidean 3-space). This problem can be 
solved easily for any particular input; for each of the 
M sample points, we compute its distance to all N 
training points, and return the point with the minimum 
distance. The only drawback of this method is its 
excessive run time. Assuming that distances can be 
calculated in just ten microseconds (an optimistic 
assumption for many of today’s high-performance 
general-purpose computers), the MxWN distances 
computed require over three minutes of computer 
time. 

We will now investigate a systolic algorithm that 
can solve the nearest neighbors problem in less than 
a quarter of a second. The algorithm has the same 
structure as the receiving line we studied earlier. In this 
case, though, the receiving line contains the 1000 
training points. As each of the 20000 sample points 
files past the training points, it computes the distance 
to the particular point, and ‘‘remembers’’ the 
minimum distance seen so far and the point realizing 
that distance. The resulting systolic array is shown in 
Figure 1; each box in that figure is a small processor 
capable of storing two points, computing the distance 
between the points, performing distance comparison, 
and communicating with its two neighbors. 


The systolic algorithm proceeds in two phases: the 
first sets up the ‘‘receiving line’’, and the second passes 
the ‘‘guests’’ through the line. In the first phase, each 
of the 1000 training points is loaded into a separate 
processor in the systolic array. The second phase is 
responsible for computing nearest neighbors; it does 
this by writing the 20000 sample points into the input 
of the systolic array and then reading them from the 
output. During this process, each processor is 
controlled by a global clock, and performs the 
following actions at each clock cycle: 


e Read from the left neighbor a sample 
point, the name of its nearest neighbor seen 
so far, and the distance to the nearest 
neighbor. 

Compute the distance from the sample 
point to the training point contained in this 
cell. 

Compare the distance just computed with 
the distance to the nearest neighbor seen 
so far (the minimum distance is then used 
by the next step). 

Make available to the cell to the right the 
following information: the sample point, 
the minimum of the closest distance so far 
and the distance to this training point, and 
the name of the point realizing the 
minimum distance. This information will 
be read by the cell to the right at the next 
clock cycle. 


Notice that the rightmost cell in the systolic array 
outputs the sample points, their distances to their 
nearest neighbors, and the names of the nearest 
neighbors. We give input data to the array at each 
clock cycle in packets containing a sample point and 
a fictitious nearest neighbor so far that is ‘‘infinitely’’ 
far away (that is, we give it the greatest possible 
distance). 









































Figure 1. A linear array for the nearest neighbors problem. 
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The total time required by this method is 1000 
units to load the array and 20000 units to pass the 
entire set of sample points through the array, for a 
total of 21000 time units. If we asume, as before, a 
ten-microsecond clock, then the entire problem can be 
solved in about 0.2 seconds (a factor of 1000 faster 
than the straightforward solution). In general, 
computing the nearest neighbors of M sample points 
among N training points can be accomplished in M+ N 
time units. (Notice that use of N processors yields a 
speedup factor of N over the straightforward single- 
processor algorithm.) If the performance of a solution 
to the nearest neighbors problem is in the time 
bottleneck of a system, then this approach could 
clearly have a substantial impact. This systolic 
approach is particularly well-suited to implementation 
in VLSI; it uses only local communication, and it 
utilizes only one basic cell that can be designed once 
and then copied many times. Note, though, that the 
cost of designing and implementing a systolic solution 
to this problem will be significantly greater than merely 
writing a (short) program to solve the task on a 
general-purpose computer: this is a tradeoff of design 
time against processing time. 

There are a number of variations possible on the 
basic theme of using a linear array to solve the nearest 
neighbors problem. In the previous solution, the 
training points remained in the same processor while 
the sample points marched past them, carrying the 
answers along with them. We could have organized 
the system so that the M sample points each stayed 
in a processor while the N training points moved past 
them; this would still required approximately M+ N 
time units. There are two possible motivations for this 
alternative approach: 


e If there are fewer sample points than 

training points (that is, if M<N), then this 
requires fewer processors. 
Because the answers remain in the same 
processor as they are computed, this 
approach might involve less data 
movement. 


Kung [2] investigates a problem from a signal- 
processing application with a similar structure, and 
shows how a half-dozen linear-array systolic 
algorithms are each appropriate under various 
conditions. 

We will now briefly consider two problems that 
can lead to other variations. 


e What happens if there is an overflow? 
Suppose we have a systolic device of 1000 


Two/1983 


processors, but we have to solve a problem 
with M = 20000 and N= 2000. We can solve 
this problem by decomposing the training 
point into two sets of 1000 points each (so 
that they will fit in the array), and then 
passing the 20000 sample points through 
the array twice (once for each of the set). 
This solution will not be as efficient as the 
case when all points fit in the array, but the 
array costs only half as much. 
What happens if points are not atomic 
elements? Throughout this discussion we 
have assumed that points in Euclidean k- 
space were given as basic units; in fact, on 
almost all computers (systolic and general- 
purpose alike), such items will have to be 
implemented in terms of other primitives. 
Figure (2) shows one possible solution for 
the nearest neighbor problem if we must 
deal with one-dimensional scalar values as 
primitives. This particular array is 
specialized to hold four points in three- 
space, named a, b, c and d; the coordinates 
of each point are stored in the columns of 
the array. The sample points then flow 
from left to right, slanted at a 45° angle. 
The cumulative sum of the squares of the 
differences of the coordinates flows from 
the top to the bottom of each column; 
when it reaches the circular nodes at the 
bottom it is compared to the minimal 
distance seen so far, and the minimum of 
the two (along with the point realizing that 
distance) flows to the right. Finally, the 
output of the nearest neighbor to each of 
the sample point flows out the rightmost 
circle. This discussion is only a sketch of 
the problem; filling in the details of the 
data flow is a fine exercise for the 
industrious reader. 


Figure 3 shows a systolic array for the nearest 
neighbors problem based on the non-linear structure 
of a binary tree. The training points are stored in the 
square nodes; the sample points flow in the topmost 
circular node and are broadcast by the circles to the 
squares, the distance are computed in the squares, and 
the minimum of the distances is computed by the 
triangles and returned out the bottom triangle. This 
structure yields a solution that has the same 
throughput for the problem as the linear array, but 
has much faster response time. The details of this 
scheme are given by Bentley and Kung [6]. 

This simple example illustrates many principles 























































































































Figure 2. A Two-dimensional array for the nearest neighbors problem. 


Figure 3. A tree-structured machine for the nearest neighbors 
problem. 
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of systolic algorithms for VLSI implementation. The 
choice of problem is crucial in any system; we solved 
the particular problem of nearest neighbor searching, 
but our work is justified only if that problem is of great 
importance in some application. Another approach 
would be to build a special-purpose processor to solve 
the more general problem of searching; Bentley and 
Kung [6] describe one approach to this problem. Our 
experience in this section has touched on many aspects 
of data flow in systolic systems: we saw two distinct 
ways in which the data can flow in simple linear arrays. 
We also saw three distinct geometric structures for 
solving the problem: a one-dimensional linear array, 
a two-dimensional array, and a tree. In the next section 
we will see that these structures are just a few scattered 
points in much larger design space. 


An Overview of Systolic Designs 


In the previous section we studied one systolic 
algorithm in detail; in this section we shall take a 
broader (but shallower) view and survey the field of 
systolic designs. In the following subsection: ‘‘Design 
Techniques,’’ we will study a set of techniques used 
in the design of systolic systems; ‘‘A Catalog of 
Results,’’ we will survey some of the theoretical results 


those techniques have achieved; and ‘‘Reduction to 
Practice,’’ we will describe how the theoretical ideas 
can be, and have been, implemented in current 
technology. 


Design Techniques 


The example above showed that there are 
many possible systolic solutions to a given problem, 
and many variants of a basic solution. During the early 
development of systolic algorithms, each new problem 
seemingly required a fundamentally different solution. 
As time passed, though, and a larger set of problems 
and solutions was assembled, it became clear that there 
is a fundamental set of design techniques underlying 
most systolic algorithms. In this section we will briefly 
survey some of the more important of those 
techniques. 

One of the most obvious properties of a systolic 
design is its basic geometric structure. In the previous 
section we saw several possible geometries; the 
following list categorizes those and several other 
popular layouts for systolic algorithms. 
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Linear Array. Figure 1 shows a simple 
structure ideal for solving problems with 
an inherently linear structure. 
Rectangular Array. Figure 2 is an instance 
of a rectangular structure suitable for 
certain matrix applications and for 
database applications in which each record 
contains several fields. Variations of the 
basic rectangular array include traingular 
and trapezoidal arrays. 

Tree Structures. Figure 3 shows one variant 
of a tree structure—several others are 
suitable for various problems. 

Hexagonal Array. Figure 4 from Reference 
1 is a structure well-suited to matrix 
operations such as multiplication of band 
matrices. 





Figure 4. A hexagonal array. 


Once the geometric structure is chosen, the 
designer must still decide how data will flow through 
it. In the previous section we saw how one kind of data 
can stay stationary while the other kind flows past it. 
There are many more complicated kinds of data flow; 
the following set of flows just scrapes the surface of 
data flow for the simple structure of a linear array. 


e One kind of data flows left while the other 
flows right; the answers stay in the same 
place. Only half the processors are used on 
any clock cycle; the unused half can be 
used to solve an entirely distinct problem. 
One kind of data flows left, and the other 
kind stay in the same place; the answers 
flow left at twice the speed. 

There is only one kind of data, but it flows 
left or right as a function of the data 
contained in its neighbors. 





Kung [2] shows that there are at least eight 
different data flows through a linear array which solve 
a single problem. Data flow through a more complex 
geometric structure can often be even more subtle. 

Two theoretical fields are developing the potential 
to aid the designer of systolic systems. The field of 
lower bounds seeks to show that a certain set of 
resources is necessary to solve a problem systolically. 
Thompson [7] developed an appropriate mathematical 
model of VLSI and derived fundamental results using 
general techniques; since then the techniques have been 
extended and applied to many other problems (see, for 
instance, Brent and Kung [8]). Hong and Kung [9] 
have described a general model of special-purpose 
computing devices that allows one to derive bounds 
on the efficiency of off-loading computation. A second 
theoretical field is developing a set of transformations 
that allow systolic designers to assume that they have 
certain freedom not actually present in most VLSI 
technology; transformations are then used to convert 
the resulting designs into systolic designs appropriate 
for the technology at hand (Leiserson and Sax [10] 
describe such transformations). 


A Catalog of Results 


In previous sections we have seen one problem in 
detail and several different systolic arrarys for solving 
it under various constraints; we have also surveyed a 
number of design techniques for building systolic 
systems. This section catalogs a number of other 
problems that have been solved by systolic systems. 
The purpose of this catalog is two-fold: to provide 
references for readers interested in exploring a systolic 
solution to a particular computational problem they 
might face, and to show the breadth of the approach. 

Most compute-bound problems are inherently 
regular; they are definable in terms of simple 
recurrences or inner loops, such as the nearest 
neighbors problem considered earlier. By exploiting 
that regularity, systolic algorithms for these problems 
can usually be found without too much difficulty. 
Systolic designs are now available for the following 
problems. 


¢ Signal and image processing: 


o FIR and IIR filtering and 1-D 
convolution [11,12,13] 2-D 
convolution and correlation 
[14,15,16,17,18]; 

o discrete Fourier transform [12,13]; 


o interpolation [15]; 

o 1-D and 2-D median filtering [19]; 
and 

o geometric warping [15]. 


e Matrix arithmetic: 


o matrix-vector multiplication [1]; 

o matrix-matrix multiplication [1,20]; 

o matrix triangularization (solution 
of linear systems, matrix inversion) 
[21,1] QR-decomposition (eigen- 
value, least squares computations) 
[22,21]; and 

o solution of triangular linear systems 


[1]. 
e Non-numeric applications: 


data structures — stack and queue 
[23], searching [6,24,25], priority 
queue [26], and sorting [26,25]; 
graph algorithms — transitive 
closure [27], minimum spanning 
trees [28], and connected com 
ponents [29]; 

geometric algorithms—convex hull 
generation [30]; 

language recognition—string 
matching [31] and regular expres 
sion [32]; 

dynamic programming [28]; 
polynomial algorithms —pol- 
ynomial multiplication and divi- 
sion [33], and polynomial greatest 
common divisors [34]; 

relational data-base operations 
[35,36]; and 

Monte Carlo Simulation [37]. 


Reduction to Practice 


The design of systolic algorithms, on which we 
have been concentrating so far in this paper, 
constitutes just one phase of the total effort of 
constructing a systolic device for use in a 
computational system. Following this phase are 
specification of the system architecture, system design, 
and integration to the host system. For well- 
understood, highly important inner loops a systolic 
processor could be cost-effectively built for each single 
application. For example, a large quanity of low-cost, 
high-performance sonar bouys with some filtering and 
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pattern matching capabilities could conceivably be 
built based on the systolic approach. For applications 
where more flexibility is desired, however, multi- 
purpose systolic arrays could be more attractive. An 
example is the ESL systolic processor, a linearly 
connected array of 28 cells which can be microcoded 
to perform 2-D convolution, matrix multiplication, 
and other similar operations [13,17]. Figure 5 dipicts 
the ESL systolic processor, which has been running 
since January 1982, and can be called as a subroutine 
by FORTRAN programs running on a host 
VAX-11/780. 

The highest degree of flexibility can be obtained 
by allowing programmability in cells as well as 
reconfigurability of cell interconnections. The 
programmable systolic chip (PSC) being developed at 
Carnegie-Mellon (CMU) is intended to explore the 
design space of systolic processors where this highest 
degree of flexibility is achieved. The chip will form the 
basic cells for a wide variety of systolic arrays (see 
Figure 6). Note that conventional, commercially 
available microprocessor components are not adequate 


for forming cells in systolic arrays, because they do 
not have enough I/O bandwidth to pass data from cell 
to cell with a speed sufficient to balance the 
computation speed. Moreover, unlike the PSC, 
conventional microprocessors do not have fast, on- 
chip multiplier circuits which are crucial for high-speed 
signal and image processing. By using arrays consisting 
of tens or hundreds of copies of the PSC chip, we 
expect to get orders of magnitude improvements in 
speed for application including: 


Convolution-like operations in signal and 
image processing. 

Reed-Solomon encoding and decoding for 
error corrections. 

Encryption and finger-print calculations. 
Number theoretic transforms. 

Disk sorting. 


Consider the application to Reed-Solomon error- 
correcting codes as an example. Suppose that each 
codeword consists of 224 information symbols 
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Figure 5. The ESL systolic processor. 
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Figure 6. A building-block chip for a variety of systolic arrays. 


followed by 32 check symbols and each symbol is an 
8-bit interger; using the Reed-Solomon scheme, errors 
involving no more than 16 symbols can be corrected. 
We estimate that by using a linear array of 112 PSC 
chips the Reed-Solomon decoding can be performed 
in a throughput of 10 million bits per second. Encoding 
is much easier; it requires only about 30 PSC chips to 
achieve the same throughput. As far as we know, the 
fastest existing Reed-Solomon decoder with the same 
characteristics uses about 500 chips but achieves a 
throughput of only 1 million bits per second. The 
performance of the PSC-based system is largely due 
to the use of systolic array; for example, a highly 
effective systolic array has been developed for 
implementing the extended Euclidean computation, 
the most diffcult task in the decoder implementation 
[35]. Five people are currently working on the PSC 
project (July 1982). Microprograms for most of the 
applications mentioned above have been written and 
tested, using a register level simulator generated from 
a hardware description of the chip. Layouts for the 
major components, the multiplier-accumulator, the 4K 
(64 x 64-bits) memory for the control store, and the 
ALU, are complete. The architecture of the chip has 
been finalized, and the chip is to be completely laid 
out and simulated by September 1982. 


12 


We see that there is a spectrum of possibilities for 
systolic processor designs, ranging from single-purpose 
processors to general-purpose, programmable 
processors such as the PSC chip, as depicted 
conceptually in Figure 7. The choice of a particular 
architecture in the design space depends on each 
individual application problem at hand. 

It is worthwhile to note that a systolic processor 
has recently been implemented by the Naval Ocean 
Systems Center in San Diego as a testbed for a variety 
of systolic array configurations, and to understand the 
architectural features needed by various systolic 
algorithms [38]. This processor has an 8x8 array of 
cells, each containing a Intel Arithmetic Processing 
Unit and microprocessor for achieving the fexibility 
needed in the testbed. 


Future Directions 


With the development of systolic architectures, 
more and more special-purpose systems may become 
feasible—especially systems that implement fixed, well- 
understood computation routines. The ultimate goal 
is effective use of systolic processors in general 
computing environments to off-load regular, compute- 
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Figure. 7. Design space for systolic processors. 


bound computations. To achieve this goal further 
research is needed in two areas. The first concerns the 
system integration: we must provide a convenient 
means for incorporating high-performance systolic 
processors into a complete system and for 
understanding their effective utilization from a system 
point of view. The Universal Host project at CMU, 
sponsored by ONR, directly addresses this system 
integration problem. We are in the process of 
constructing a compact host system that can be 
plugged in with interchangeable, high-performance, 
special-purpose modules to fit various application 
requirements. The second research area is to specify 
more building-blocks such as the PSC chip described 
earlier for a variety of systolic processors so that, once 
built, these building-blocks can be programmed to 
form basic cells for a number of systolic systems. The 
building-block approach seems inherently suitable to 
systolic architectures since they tend to use only a few 
types of simple cells. By combining these building- 
blocks regularly, systolic systems geared to different 
applications can be obtained with little effort. 

We believe that because of the simplicity and 
regularity inherent in systolic structures, it will 
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eventually be possible to have an integrated treatment 
for all the design efforts needed to the construction 
of a systolic system, starting from application to the 
final system integration. A consequence of this 
integration is that application people will have direct 
influence on the specification and design of custom 
VLSI systems to meet their needs, while enjoying fast 
turn-around time to build the systems. @ 
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Introduction 


TT purpose of this paper is to examine certain 
generic problems of military Command, Control 
and Communications (C*) systems from the viewpoint 
of modern systems engineering and to suggest research 
avenues that appear to be promising in advancing the 
state-of-the-art for C* processes. The research describ- 
ed here is funded in part by the Office of the Naval 

Research and the Air Force Office of Scientific 

Research. 

The field of Command and Control has received 

a lot of attention in the past few years (see reference 

1 for a recent collection of views on the subject by 

several high level Department of Defense (DOD) and 

industrial contributors). The reason of this flurry of 
interest appears to be due to several factors: 

(1) There seems to be some dissatisfaction with C* 
related procurements. To a certain degree this 
dissatisfaction may stem from unrealistic expec- 
tations on the part of the military user communi- 
ty on potential performance. There have been 
several comments voiced that the hardware 
specifications and system-wide performance were 
decided by engineers that are not aware of the 
‘*true’’ needs of operational commanders. 
There is an increasing awareness that it is very dif- 
ficult to arrive at rational design specifications for 
the performance of a C’ system under a variety 
of peacetime, crisis-management, and hot war 
conditions. The integration of specifications for 
individual hardware components into a system- 
wide peformance index is a very complex task, and 
there does not exist a systematic methodology to 
aid the systems engineer to carry out the necessary 
cost-performance-reliability tradeoffs. 

The increasing range, speed, and accuracy of 
sophisticated weapons systems enlarge the volume 
of responsibility of commanders, thus 
necessitating an increased geographical dispersion 
of the commanders’ surveillance and warfare 
assets. 

The increased speed of weapons systems have 
reduced the time available for making tactical deci- 
sions by human decision makers. This requires an 
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ever increasing use of automation at all levels. 

Centralized command posts are vulnerable to 

enemy attack. This necessitates the geographical 

distribution of the command hierarchy and re- 
quires increased tactical communication among 
command centers for force coordination. 

The necessary secure and reliable communications 

links represent a very vulnerable component of the 

C’® system. Modern electronic warfare (EW) 

disrupts communications through jamming dur- 

ing the time that tactical communications are 
needed most for force coordination. Similiar com- 
munications constraints can occur due to en- 
vironmental conditions (terrain, weather, etc.). 

High power communications are also undesirable 

because the emitted electromagnetic energy can be 

detected by enemy sensors, such as high-frequency 
direction finders (HFDF). 

(7) Active, high signal-to-noise ratio sensors, such as 
radar, although excellent in the surveillance pro- 
blem, suffer from similar electromagnetic detec- 
tion problems. Passive sensors are less vulnerable, 
but they do not provide accurate information 
unless they are internetted with a high-bandwidth 
communications network. 

The above remarks indicate some of the complex 
systems engineering issues that have to be addressed 
in C’ processes. It should be self-evident that one deals 
with very complex large-scale distributed estimation 
and decision processes with a high degree of uncer- 
tainty due to environmental variables and enemy ac- 
tions. The entire command and control process is a 
cybernetic process with several feedback loops. Clear- 
ly, if a relevant set of theories and tools are developed 
for military C* systems, then these results would be 
applicable to similar problems arising in the civilian 
sector (power systems, transportation systems, etc.) 
which operate in a less stressful and less hostile 
environment. 


Some Definitions 


The words ‘‘command-and-control (C?),’’ ‘‘com- 
mand, control and communications (C°),’’ ‘‘com- 





mand, control, communications and _ intelligence 
(C?1)’”’ have different meanings to different people, and 
their indiscriminate use can create a great degree of 
confusion. For this reason, in this paper some distinc- 
tion between the C? and C? terms will be made. 
C? Process: The means by which a team of military 
warfare commanders (WC) make decisions that relate 
to the deployment and motion of the resources and 
assets assigned to them to carry-out a military mission 
specified by higher authority. 
C’ Authority and Responsibility: This refers to the fact 
that a particular commander can instruct, direct, posi- 
tion, move, and, in general, control the human and 
physical assets assigned to him by his superior com- 
mander. The responsibility is to accomplish the specific 
objectives spelled out to him by his superior 
commander. 
C? Organization: The semihierarchical way and 
organizational rules by which the human commanders 
organize themselves in terms of C’? authority and 
responsibility by warfare area and/or geographical sec- 
tor. Rules of engagement and tactical doctrine are an 
integral part of the C’ organization. 

We remark that in this paper we shall use the term 
C? to primarily relate to human decision making. Ob- 
viously commanders need real-time information to 


make decisions and weapons systems that eventually 
implement a subset of their decisions. This leads us 
to the following definitions. 

C* System Elements: The physical and technological 
hardware and software that generate, manipulate, 
communicate, and display information and the 
weapon systems. Thus typical C* System Elements are: 

(a) Sensors (Fixed or Moving); 

(b) Communication Links (mostly radio for tac- 

tical C? and related devices; 

(c) Computers and Displays (hardware, software, 

firmware, decision aids) viewed as systems; 

(d) Weapon platforms and weapons systems. 
C?® Systems: The physical system and its architecture 
that defines the interconnection of the C* elements. 
Thus it is the C*® system that: 

(a) generates data and information for different 

WC’s in the C’ organization; 

(b) allows for coordination among several WC’s; 

(c) provides means for implementing the decisions 

generated by the C’ process. 

It should be noted that the physical elements of 
the C* systems, as well as the warfare commanders 
(WC) are naturally and/or intentionally geographically 
distributed; geographic distribution reduces the 
vulnerability of the C? organization and of the C’ 
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system to enemy attack but strains the radio com- 
munication requirements* necessary for coordination 
among WC’s and to carry out the C’ process. 
Figure | represents a highly simplified schematic 
of the C? process interacting with the C’ system. It 
represents a highly multivariable dynamic and 
stochastic feedback control process or a cybernetic 
process. The emphasis of Figure | is upon the func- 
tions of the organic C* system as providing informa- 
tion (not data!) to the C? organization and acting as 
an actuator or effector that suitably transforms the col- 
lective decisions of the WC’s into physical events. 
Parenthetically we remark that the inclusion of 
weapons as part of the C*® system is not a widely ac- 
cepted convention. It is the author’s opinion that they 
must be included since at a minimum they will generate 
tracks at a subset of sensors and they must be sorted 
out from the enemy and neutral objects and targets. 
Also, when we consider coordination problems among 
WC’s with respect to proper utilization of 
multiwarfare-capable assets, it becomes very difficult 
to define multiwarfare-capability at a systems level 
without explicit consideration of the weapons systems 
that are carried in that asset. Finally, the whole issue 
of fratricide cannot be addressed in the absence of 


weapons. 
The function of the C’ system is to provide rele- 
vant, accurate, and timely information to the com- 


manders so that they can make correct decisions regar- 
ding the deployment and movement of their forces and 
resources, carry out the necessary resource allocations, 
and achieve the objectives assigned to them. To ac- 
complish their missions the commanders must establish 
a command and control (C’) organizational structure 
that can deal effectively with rapidly changing tactical 
situations. The necessary C? organizational structure 
is very much dependent upon sensors, communica- 
tions, and weapons technology. This is a key point to 
keep in mind. For example, in the absence of tactical 
communications, the organizational structure must be 
such that each commander can operate in an open-loop 
manner (or according to doctrine in military language). 
Clearly, a different organizational structure will be 
more effective if communications are available, so that 
force and resource coordination can be carried out in 
real time (closed loop command and control). 





*Radio communications bandwith is the most precious and 
vulnerable element in the C’ system because of its susceptibility to 
jamming. Spread spectrum techniques can reduce the jamming 
vulnerability, but there is just so much bandwith in the universe. 
UHF communications are less susceptible to enemy intercepts and 
localization, but constrain the system to line-of-sight 
communications. 
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The distributed nature of the sensors and the 
distributed nature of human decision makers obviously 
interact with the architecture of the C* system. It is 
unrealistic to expect that all relevant information is 
transmitted in a timely manner to all decision makers; 
this would consume valuable (and vulnerable) com- 
munications resources and require a large time-delay. 
Even if such ‘‘global’’ information could be transmit- 
ted to all human decision makers; they would be 
‘“‘swamped’’ with information, and they would be 
unable to use it effectively under the stringent time 
constraints within which commanders must operate in 
a stressful tactical engagement. 

The above remarks illustrate the fascinating 
system-theoretic issues that arise in military command 
and control. These problems suggest new and unex- 
plored avenues for theoretical research in modern 
systems, estimation, and control theory. The problems 
are clearly of the large-scale system variety, but quite 
different from those considered in the system-theoretic 
literature. 


Human Decision Makers 


In this paper, the tactical aspects of command and 
control will be discussed leaving aside the strategic and 
planning issues; these are extremely important, and 
quite often the success of a mission will crucially de- 
pend upon careful planning, resource allocation, and 
logistic support. These set up some of the goals and 
constraints that a commander must operate under in 
any given tactical situation. 

The purpose of a C’® system is to provide the 
necessary information to a team of human decision 
makers so that they can carry out the mission assign- 
ed to them. 

It is very important to stress that tactical decisions 
in a modern warfare environment are carried out by 
a team of commanders, rather than by a single com- 
mander. The reason for this is obvious. Weapons 
technology has progressed to the point that no single 
human decision maker can be an expert on all offen- 
sive and defensive options; even if he were, there would 
be no time to absorb all information and execute all 
decisions. To be sure, there is and there always will 
be a traditional military command hierarchy; however, 
from a functional point of view, modern warfare re- 
quires a much more fluid structure as far as tactical 
decision making is concerned. 

To illustrate this concept, let us consider a naval 
battle group or task force consisting of at least one 
aircraft carrier together with several other platforms 





(cruisers, destroyers, etc.) and support vessels. Such 
a task force is capable of conducting simultaneously 
anti-submarine warfare (ASW), anti-air warfare 
(AAW), and anti-surface warfare (ASUW) in the sense 
that it possesses both the sensor and weapons 
resources, distributed among the platforms, to engage 
simultaneously submarines, aircraft, ships and missiles 
(which can be launched from submarines, airplanes, 
and ships as well as land bases). In order for the task 
force to be successful in such a complex engagement 
requires the coordinated decision making of several 
commanders, who may not necessarily be colocated. 
The U.S. Fleet has adopted the doctrine of Composite 
Warefare Commander (CWC) who oversees the ac- 
tions of an ASW Commander (ASWC), and AAW 
Commander (AAWC), and an ASUW Commander 
(ASUWC). Each of the three subordinate commanders 
has a functior i responsibility for defensive and of- 
fensive decision and actions in his area of ‘‘expertise.’’ 
Interestingly enough the CWS ‘‘governs by negation;”’ 
the CWC monitors the decisions of the ASWC, 
AAWC, and ASUWC and he only intervenes when 
either an inappropriate (in his mind) decision is con- 
templated or when there is obvious need to resolve con- 
flicts related to resource allocation. 

The three main commanders (ASWC, AAWC, 
ASUWC) are those that issue C’? orders. However, 
their actions are influenced by inputs of coordinators 
(such as the screen coordinator, electronic warfare 
coordinator, helicopter coordinator, etc.) who have 
responsibility for a certain function associated with 
resources controlled by the commanders (ASWC, 
AAWC, and ASUWC). These coordinators monitor 
the status of the specific problem assigned to them and 
provide recommendation to the commanders on what 
to do. Interestingly enough one can abstract the ob- 
jectives of the coordinators in terms of specific detec- 
tion, survival, deception, and kill probabilities in their 
specific area of responsibility. Also note that the coor- 
dinators do not serve necessarily as staff to one of the 
commanders; rather they assess situations and generate 
recommendations that may involve the assets of more 
than one commander. 

The above discussion illustrates that although 
there is a clear cut command hierarchy (e.g., admiral, 
captain, etc.), the team-decision mechanism in a tac- 
tical situation is not hierarchical is nature (where the 
word hierarchical is used in the strict system theoretic 
context). 

Such team coordinator issues are not unique to 
the Navy. Even more complex tactical coordination 
issues arise when one considers a land warfare scenario 
which involves the coordinated actions of both Air 
Force and Army assets. In this case the problems of 


tactical coordination are further complicated by the 
existence of traditional chains of command between 
two services as well as necessary coordination with 
Allied ground and air assets.** 

Thus, if one examines tactical warfare one must 
immediately come to grips with problems of 
distributed decision making by teams of expert com- 
manders. For maximum effectiveness the resources 
available must be coordinated in time and in space. 
The complexity of the problem requires a division of 
responsibility and a certain autonomy in the decision 
making process of an individual commander. On the 
other hand, the commanders must communicate selec- 
tively for best resource utilization; communications 
may be subject to constraints especially when the com- 
manders are geographically distributed to decrease 
vulnerability. It is precisely the function of the C’ 
system to provide to each commander the right infor- 
mation at the right time so that he can accomplish the 
mission assigned to him, and to allow for the necessary 
coordination of the team resources and decisions. 

The most information that a commander needs 
is the location, velocity, and identity of his own, the 
enemy’s and neutral objects. Past motion history is 
often important in deducing the enemy intentions. Fuel 
and weapons availability related to one’s own assets 
is obviously important also. Such information must 
be gathered by the C? surveillance system. It is impor- 
tant to stress that in a tactical situation, surveillance 
and tracking information can be collected by a varie- 
ty of sensors. Often the sensor measurements must be 
‘*fused,’’ i.e. correlated with each other so as to pro- 
vide an accurate situation estimate (some sensors such 
as radar provide very good position information but 
not identity; others, such as ESM can provide some 
identity information but poor position accuracy). 
Because the sensors are geographically distributed, 
there is a significant time delay before an accurate 
situation plot can be generated and transmitted to the 
commanders. 

In a tactical situation each commander is 
presented with a view of the ‘“‘state of the world’’ 
which he knows can be inaccurate and not necessarily 
very timely. Nonetheless, on the basis of this in- 
complete information, each comander must make deci- 
sions consistent with the constraints imposed by the 
preplanned actions. Typical decisions involve: 

(a)Control of surveillance resources (e.g. turn on 

a radar, launch a reconnaisance aircraft, etc.) 
to gather more information or clarify am- 
biguous information; 

(b)Control of electromagnetic radiation (e.g. 

communicate or not, jamming strategies, 
etc.); 
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(c) Control of resources (e.g. relative position of 
ships, aircraft, tanks, troops, etc. and control 
of their movements); 

(d)Assignment of weapons to targets (e.g. sortie 
planning by deciding what aircraft, from what 
bases should be armed, with what weapons to 
attack what targets or other objects of military 
value); 

(e) Weapons control. 


These decisions are always made by human com- 
manders. Some of the decisions are strategic in nature, 
i.e., they are the outcome of extensive preparation and 
planning. In a system-theoretic context, the strategic 
decisions and planning are roughly equivalent to the 
establishment of desired open-loop controls and tra- 
jectories; and one can argue that such strategic or com- 
mand decisions are the outcome of a static or dynamic 
deterministic optimization problem. In this phase, in- 
telligence information is crucial. In the planning phase, 
many details are not taken into account. Uncertainty 
is usually handled by planning in detail alternate op- 
tions; specific and unambiguous objectives and direc- 
tives are command for execution and implementation 
by the appropriate commanders. Generally’, subor- 
dinate commanders are told who, what, where, when, 
and why. In general, subordinate commanders are not 
told ‘‘how’’; it is up to the subordinate commander 
to develop a detailed tactical plan of action to ac- 
complish the objective assigned to him. 

It is useful, in the opinion of the author, to think 
of the ‘‘command’’ function in C? systems as being 
completely analogous to the open-loop control con- 
cept of modern control theory. The command func- 
tion effectively specifies the reference trajectories in 
time and space (and alternate ones) for the mission to 
be performed. Although the tactical actions will be ex- 
ecuted by a geographically distributed set of subor- 
dinate commanders according to their best decisions 
(remember the ‘‘how’’ is not specified), the availability 
of a global open-loop plan provides valuable open- 
loop coordination among distinct units. For example, 
neighboring platoons in a land warfare scenario will 
know the planned location and plans of adjacent units, 
as well as the time and place of close air-support opera- 
tions. This helps a platoon commander plan his own 
course of action by correctly allocating his own defen- 
sive and offensive resources. 

The word ‘‘control’’ in C? systems refers to the 
function that indeed the preplanned courses of action 
are more or less being accomplished in a tactical situa- 
tion. In the author’s opinion, the ‘‘control’’ function 
is completely analogous to ‘‘feedback.’’ Real-time 
surveillance provides the commander with an estimate 
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of the ‘‘state of the world’’; he compares this with the 
desired state associated with the command process, 
and real-time decisions are made to control in real time 
the available resources to correct for undesirable 
deviations.‘ 

The nature of real time information by the tac- 
tical surveillance system can impact the overall deci- 
sion process in different ways. A crucial piece of 
‘‘global’’ information is one that violates a key 
assumption* under which the operational battle plans 
were made. This may necessitate the implementation 
of alternative operational plans at the highest level. 
If such a contingency were taken into account in the 
planning process, the alternate plans can be sent easi- 
ly and rapidly to the subordinate commanders. If, on 
the other hand, this contingency was not anticipated, 
and there is no time for drawing another set of plans 
(or if the communications environment does not per- 
mit transmission of the commands), the tactical situa- 
tion will become chaotic at least in the short run. 

The feedback ‘‘control’’ function requires the 
real-time reallocation by an individual warfare com- 
mander of the resources to meet his objectives. 
Sometimes he can accomplish this with the resources 
alloted to him; in certain cases, the situation 


necessitates the real-time coordination of the resources 
of two district commanders, and this obviously re- 
quires tactical communications. 


The above discussion illustrates the nature of the 
decisions that have to be carried out by individual com- 
manders, at different levels of the command hierar- 
chy. The quality of the decisions made by an individual 
commander depend on the following key factors: 

(a) The nature, quality, and especially timeliness 
of the available information (this can be 
greatly influenced by a superior C* system); 

(b) The rules of the engagement (these act as 
constraints upon the commander’s decision 
process); 

The goals and objectives assigned to him by 
superior commanders at the strategic plan- 
ning phase; 





*A good example is the naval battle at Midway Island during World 
War II. The Japanese plans to invade Midway were based upon the 
intelligence assumption that the U.S. carriers were at Pearl Har- 
bor. By breaking the Japanese code, the U.S. Naval forces knew 
of the intended invasion of Midway, and Admiral Nimitz dispatch- 
ed a three carrier force near Midway. The presence, location, and 
size of the U.S. task force did not become apparent to the Japanese 
until the battle started. This may have been a deciding factor in the 
battle outcome, in which the Japanese lost four of their large air- 
craft carriers, and abandoned the invasion plan. 





(d) The commander’s available resources (these 
again act as constraints to his decisions); 

(e) The planning horizon time; 

(f) The complexity of the tactical situation vs. 
the time available to arrive at a satisfactory 
decision (computer decision aide for the 
commander can help him to either arrive at 
better decisions within a given time limit 
and/or complete his decisions sooner). 

The overall global outcome of any engagement will 
clearly depend upon the quality of the decisions of the 
distributed commanders. 


System - Theoretic Research Issues 


In the above section we discussed generic issues 
associated with the Command and Control process. 
In this section we outline some relevant research direc- 
tions, from a system-theoretic viewpoint, that are 
necessary to develop methodologies and theories for 
C? systems. 

Clearly military C’ systems fall in the category of 
large-scale distributed decision systems. In spite of the 
many advances in large-scale estimation and control 
systems', we do not have a unified theoretical 
methodology for such systems. 

Although C? systems fall in the category of large 
scale systems, nonetheless they are characterized by 
certain key properties and attributes that must be taken 
in account. These are: 

(1) They are event-driven, 

(2) The dynamics* tend to be trivial, and there is not 
a significant dynamic coupling among the system 
elements, 

(3) The coupling occurs primarily at the resource 
allocation level and the coordination of the 
resources in time and in space. 

Military C’ systems are characterized by geographical 
dispersion and phenomena that involve multiple time 
scales (for example, ASW operations are slow as com- 
pared to AAW operations). This spatial and temporal 
decomposition naturally leads to command distribu- 
tion without the need for extensive coordination in 
many cases. 

From a technical point of view, the distributed 
detection and estimation problems that arise in the 
surveillance area and in the sensor tasking area appear 





*By this we mean the trajectories of aircraft, ships, missiles, tanks, 
etc. The motion of these resources does not create a dynamic coupl- 


ing as in the case with large scale power systems. 


to be those that are most amenable to analytical treat- 
ment. Unified theoretical and algorithmic approaches 
are needed in: the generic problem of multiple 
geographically distributed sensors tracking multiple 
geographically distributed objects, the networking of 
these sensors, the necessary distributed data base 
management issues, and the communications re- 
quirements. A recent paper® discusses some of the 
issues in the C? surveillance functions so no more com- 
ments on that topic will be given here. 

The greatest challenge by far is to understand the 
interactions of a distributed team of human decision 
makers with the mechanistic and electronic com- 
ponents of the C’ system. Fundamental understanding 
is required of the proper functional organizational 
structure of human commanders with the organization 
and architecture of the underlying C* system. It should 
be stressed that technological advances in the 
mechanistic and electronic components of the C’ 
systems (weapons, sensors, computers, communica- 
tions, etc.) will have a definite impact upon the 
organizational structure of the commanders, including 
their geographical distribution to reduce the 
vulnerability of centralized command and control 
centers. Tactical coordination will increase as multi- 
purpose platforms (ships, aircraft, etc.), capable of 
performing simultaneously many functions (e.g., 
ASW, AAW, ASUW, EW), become increasingly 
available. 

One cannot avoid facing squarely the issue that 
we must develop normative mathematical models for 
individual decision making. One approach that is 
under consideration’ is to attempt to model the deci- 
sions of a well-trained expert human commander as 
the output of a constrained optimization (static or 
dynamic) problem. In this formulation, the constraints 
on the optimization problem are related to the infor- 
mation available to the commander, the rules of 
engagement, the assigned resources, the desired mis- 
sion, the planning horizon, and time-deadlines. The 
greatest problem area is to quantify the objective func- 
tion used by the human consistent with his limitations 
in problem solving. A key constraint that must be in- 
cluded in the problem formulation is the limitations 
of human short-term memory (STM)'°. Information 
that is being processed by the central nervous system 
has to be held in STM, which represents a memory of 
notoriously short term capacity; human performance 
on cognitive tasks is dramatically sensitive to the limits 
of STM. On the other hand, an experienced well- 
trained expert has stored a tremendous amount of in- 
formation in long term memory (LTM). As Simon 
points out'®, ‘‘the accumulation of experience may 
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allow humans to behave in ways that are very nearly 
optimal in situations to which their experience is per- 
tinent, but will be of little help when genuinely novel 
situations are presented.’’ It may very well be possi- 
ble to abstract the human’s objectives by suitable com- 
binations of conditional detection probabilities, decep- 
tion probabilities, survival probabilities, and kill pro- 
babilities to properly take into account the risk-taking 
and risk-aversion characteristics of human decision 
making.*? 10 glly 12 

Normative models for humans are not new in con- 
trol theory. There have been several successful and 
validated models of a human acting as a control.” '’ 
Recently, these normative models have been extend- 
ed to the case of a single decision maker having to ac- 
complish a multiplicity of dynamic tasks under time 
deadline constraints’. These results are very encourgag- 
ing, not only because there is good agreement between 
the theoretical predictions of the normative optimal 
decision model for the human and the experimental 
data, but also because they demonstrate that for rapid 
tactical-like problems with significant uncertainty the 
planning horizon of the human tends to be short. This 
is consistent with the limitations of short-term memory 
discussed above which precludes the human from solv- 
ing in his head stochastic dynamic programming pro- 
blems with long planning horizons. 


It is important to stress that such normative 
models of warfare commanders cannot be developed 
in a vacuum; they must be developed in the context 
of the physical C* system. An expert naval anti-air war- 
fare (AAW) commander would not do a very good job 
if all of a sudden 100 Backfires appeared 150 miles 
from the carrier. This would represent a ‘‘novel’’ situa- 
tion. However, such an event is extremely unlikely; it 
is precisely the intelligence and surveillance function 
of the C*® system to prevent having the AAW com- 
mander having to face such a novel situation. 

We shall refer to such normative models of an in- 
dividual warfare commander as his Principal Expert 
Model (PEM). The PEM reflects the superior ability 
(expertise) of a well-trained commander to make tac- 
tical decisions in the warfare area/sector of his C? 
authority and responsibility. 

Figure 2 illustrates the key elements of the PEM. 
The ‘‘blocks’’ within the PEM are those that must be 
reflected in the human-optimization model. 

(1) The Model of the World in the area of the 

WC expertise must include as a minimum the 
disposition of his own assets, enemy assets, 
and capabilities of the sensor and weapon 
systems under his control. His mental model 
in his LTM will be updated by tactical in- 
formation processed by his STM. The tac- 
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Figure 2. Conceptual Model of the C* Decision Process. 
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tical information and the interactions bet- 
ween STM and LTM leads to a small set of 
alternate hypotheses which correspond to 
situation assessment. One can indeed argue 
that one of the key functions of the physical 
C? systems would be to provide quality and 
timely information to the WC so as to 
minimize the situation assessment 
hypotheses (through reduction in uncertain- 
ty) since the generation of multiple ‘‘what 
is going on’’ hypotheses stress the limitations 
of the STM. 

Based on the situation assessment, a set of 
decision options must be generated and 
eventually a particular decision option is 
selected. This process clearly involves the 
correlation of tactical training stored in 
LTM and is influenced by: 

(a) the objective function which 
abstracts the mission respon- 
sibility and objectives dictated by 
his superior command; 
the planning horizon that dic- 
tates the time-urgency of the 
WC’s tactical decisions; 
any constraints on his allowable 
decisions imposed by the C? 
organization (rules of engage- 
ment, EMCON status, use of 
tactical nuclear weapons etc.); 
available resources (platforms, 
sensors, weapons, etc.) and 
dynamic constraints (speed, 
maneuvarability). 

Obviously the decision option generation is one of the 
most complex aspects of human decision making. It 
has been claimed* that experienced commanders tend 
to generate fewer options as compared to more novice 
commanders. This can only be explained that superior 
tactics are better organized as ‘‘patterns’’ in the ex- 
pert commander’s LTM, thus minimizing the 
‘*chunks’’ that are transferred in the STM. 

It should be noted that the above qualitative 
description of the Principal Expert Model (PEM) 
represents a mild extension of the SHOR (Sense- 
Hypothesize-Options-Resolution) proposed by Wohl’. 
Once more the quality of the information presented 
by the physical C* system can have a significant im- 
pact upon the decision option generation process. 





*Based upon private communication with Dr. A. H. Levis, 
Mr. J. G. Wohl, and Gen. Cushman, U.S. Army (ret.). 


’ 


For example, gridlock errors among different 
surveillance platforms can cause a single target to ap- 
pear as two or more targets; the WC must assess this 
possibility in his option generation and selection. 
Similarly any delay in communicating a weapons- 
release command to the actual weapon release will in- 
fluence the tactical decision process. 

The PEM must be by necessity a detailed model, 
and even in a single warfare area the amount of tac- 
tical information may saturate a single WC; it is for 
this reason that a major WC is augmented by his staff 
to avoid information overload. This has led Boettcher 
and Levis'* to develop information-theoretic models 
of human decisions. 

The normative models that represent the PEM of 
a particular WC are not necessarily complex. The 
reader should keep in mind that the only reason that 
these models are necessary is to understand the interac- 
tions between the physical C’? system and the com- 
manders within the organization. The decision 
variables of the commanders are relatively simple at 
each instant of time since they relate to: 

(a) positions and motions of assets, 

(b) turning on or off sensors and other 

surveillance assets, 

(c) communication with other commanders, 

(d) timing of above decisions. 

The process by which decisions are arrived at are com- 
plex; but these are carried out in the mind of the com- 
mander who is modeled as an expert in this decision- 
making task. The only degradation in his decision- 
making is due to the C* system that may give him too 
much or too little information, and only partial infor- 
mation about the enemy’s assets and their motion. 

Therefore, the PEM’s must be stochastic and 
dynamic models, and must have a feedback 
mechanism. Thus, they cannot be purely prescriptive 
and open-loop (e.g., modification of linear program- 
ming algorithms); rather they must represent adequate- 
ly the cybernetic feedback process of Figure 1*. The 
successful human control and decision models 
developed to date ’’'*, indeed fall in this category. Thus 
the PEM’s should nor explain how a WC arrived at 
his decision; rather it should explain how the infor- 
mation generated by the C’ system pertrubs his in- 
herent tactical decision process. 





*This is in philosophical agreement with the central hypothesis pro- 
posed by Simon in reference [16], p. 65: ‘‘A man, viewed as a behav- 
ing system, is quite simple. The apparent complexity of his behavior 
over time is largely a reflection of the complexity of the environ- 
ment in which he finds himself.’’ Indeed one could argue that a 
“‘good’’ C’ system should not increase the complexity of the true 
tactical scenario through the information that it transmits to the 
WC’s. 
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Needless to say, the very issue of developing nor- 
mative models for human decision makers, and 
especially military commanders, is a very controver- 
sial one. Assuming for the time being that such models 
can be developed and validated, they can be used to 
represent the most probable decision of an ensemble 
of well trained commanders in the same area of ex- 
pertise, together with a measure of variability (e.g., 
standard deviations). Thus, such normative models 
cannot be used to model any particular commander. 
Also, it is unlikely that such normative models can pro- 
vide us with rules on how ‘‘great military geniuses’”’ 
think. 

One can engage in endless discussions on model- 
ing human decision making. It is the opinion of the 
author that such arguments, although intellectually in- 
teresting, have little to do with the problem of pro- 
perly designing the architecture of a C’ system that is 
intended to support the decisions of many com- 
manders. If we do develop adequate normative 
models, these will be very useful in carrying out 
engineering and cost/effectiveness tradeoffs on the C’ 
system hardware and architectures. They can also be 
very useful in carrying out computer aided war games, 
in which the functions of low-level subordinate com- 
manders are replaced by computer algorithms, thus 
allowing the war game to be played realistically at a 
global level with many fewer human resources. This 
would result in significant savings. (A complex naval 
war game, of the type played at the Naval War Col- 
lege in Newport, R.I., may involve 150 players; the 
computer is primarily used for bookkeeping purposes.) 

Much novel research is needed to combine such 
normative models of individual commanders into a 
distributed team decision model. This will allow the 
study of alternate organization structure in conjunc- 
tion with the architecture of the C’ system, as a func- 
tion of the tactical situation. Very little military doc- 
trine has been developed in defining the command and 
organizational structure best suited to coordinate 
forces with a significant content of multipurpose plat- 
forms. If a relevant command organization theory 
could be developed, then it would be very useful in 
defining suitable adapative changes in command 
following an initial engagement in which some 
resources, including those associated with the C* 
system, were destroyed. It would also be useful for 
counter-C’ studies, by isolating most vulnerable inter- 
faces between the command organizational structure 
and the C* components. From a system-theoretic view- 
point, very little has been done along these lines. The 
methodology in reference [14] (which deals with issues 
of team decision making by a distributed set of ‘‘ex- 
pert’’ decision makers, each with a limited model of 
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the world) could be a useful first step in this class of 
complex problems. 


Concluding Remarks 


In this paper a brief discussion of some generic 
decision problems in military command and control 
organizations was presented. Also the need for nor- 
mative models of both individual and team decision 
processes was discussed. One should understand how 
to most effectively structure the human organizational 
command and control structure in unison with the ar- 
chitecture of the C’ system so as to best support the 
decisions of the commanders. 
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Orion I: Interactive Computer 
Graphics in Statistics 
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Representation of the 15% contours of a three dimensional probability density formed 
by slicing the density by parallel planes. 


he Orion I workstation is an experimental com- 

puter graphics system designed and built by Jerry 
Friedman and Werner Stuetzle at the Stanford Linear 
Accelerator Center (SLIC) in 1980-81' with the sup- 
port of the Office of Naval Research, the U.S. Army 
Research Office, and the Department of Energy. It is 
being used to explore applications of computer 
graphics—especially interactive motion graphics—for 
statistical data analysis. ?*° 

The methods being developed on Orion I are 
among the first in the rapidly growing field of com- 
puter intensive statistical methods. These new 
methods, stimulated by the evolution of computing 
technology, are creating a new paradigm for statistical 
research; graphical and other computer intensive 
methods have a strong engineering flavor, in contrast 
to the more rigorous mathematical nature of tradi- 
tional statistics. 
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Traditional Statistical Graphics 


Graphical methods are among the oldest in 
statistics. Examples of graphical representation of 
quantitative data are known from 3000 B.C.* Any 
elementary text in statistics will discuss in detail the 
standard statistical graphics, such as the histogram and 
the scatterplot. However, until recently, the develop- 
ment of new graphical methods has been outside the 
mainstream of statistical research. 

This is, in part, due to limitations of technology. 
The potential in pencil and paper graphics was 
thoroughly exploited early in the nineteenth century; 
most of the standard techniques (histogram, scat- 
terplot, etc.) were in use by the 1830's. Statisitics ac- 
quired a real identity separate from mathematics in the 
twentieth century, especially in the period after World 
War II. Thus the successful graphical methods were 





well entrenched by the time statistics emerged as a 
field; these established methods left little room for im- 
provement. Only unusually creative researchers were 
able to suggest useful additions to a statistician’s 
graphical tool kit that could be used with pencil and 


paper. 


Exploratory Data Analysis 


One of these unusually creative statisticians was 
John W. Tukey, who, in the 1960’s, developed a fami- 
ly of both graphical and non-graphical statistical 
methods referred to collectively as exploratory data 
analysis. °»°»? The underlying philosophy of ex- 
ploratory data analysis is very different from that of 
classical statistics. 

Classical statistics emphasizes mathematical 
analysis. Problems that arise directly from real data 
are usually impossible to analyze mathematically, so 
only simplified, idealized problems are considered. 
Simplifying assumptions are made so that it is possi- 
ble to determine rigorously the ‘‘best’’ solution. The 
implicit hope is that the ‘‘best’’ solution to an idealiz- 
ed problem will be a reasonable solution in more 
realistic circumstances. 

The collection of methods characterized as ‘‘ex- 
ploratory data analysis’? approaches statistical pro- 
blems from the opposite direction. These methods are 
not optimal in any precise sense. Their use is justified 
by the fact that they work in practice with real data. 


Description and Inference 


One reason that graphical methods are so dif- 
ferent from classical statistics is that they address dif- 
ferent problems. 

Using graphical methods in statistics means look- 
ing at pictures of data; the purpose of graphical 
methods is primarily descriptive. Statistical description 
is concerned with discovering and summarizing 
features of a particular data set. 

Classical statistics concentrates on mathematical 
analysis of formal methods for inference. An inference 
is a generalization from a given data set to some larger 
population (real or hypothetical) from which the data 
set is presumed to be a sample. 

Formal inference is necessarily based on 
mathemetical models. Description is neccessary, first, 
to help construct a model, and later, to check to see 
if a chosen model is really appropriate. 


Prim-9 


The introduction of modern computer graphics 
to statistics began at SLAC, in 1972, when Mary Ann 
Fisherkeller, Jerome H. Friedman, and John W. 
Tukey developed a system called Prim-9.* Prim-9 
pioneered the use of real-time motion in statistical 
graphics, most notably to display three-dimensional 
scatterplots. 

The tradional statistical graphics, the histogram 
and the scatterplot, are excellent pictures of data in 
one and two dimensions. However, it is very difficult 
to see relationships among three variavles by looking 
at histograms and scatterplots. 

With Prim-9, it was possible to see the three- 
dimensional shape of a data set using real-time rota- 
tion. If a point cloud is subjected to small rotations, 
and the rotated point cloud is projected on the display 
screen quickly enough for the motion to seem smooth; 
a viewer gets a convincing and accurate perception of 
the shape of the point cloud as a three-dimensional 
object. 

The three-dimensional scatterplot is a simple idea. 
It is an obvious and natural extension of the standard, 
two-dimensional scatterplot. However, this simple first 
step in new statistical graphics gives statisticians a 
powerful new tool. It is trivial to see and understand 
structure in data that is very difficult or impossible to 
see in any number of two-dimensional pictures. 

On Prim-9 in 1972, the display of three- 
dimensional scatterplots stretched the limits of the 
available computing power. The computation was 
done on SLAC’s large, central, mainframe computer, 
and IBM 360/91. The total cost for hardware in 
Prim-9—the 360/91, the graphics device, and a high 
speed channel to transfer data from the 360/91 to the 
graphics device—was millions of dollars. 

Prim-9 made a strong positive impression when 
it first appeared, but it did not have much immediate 
impact on the practice of statistics. The expense of the 
hardware made it impractical for such systems to be 
developed except at special institutions such as SLAC. 

Successor to Prim-9 were developed by Peter 
Huber and his students in Switzerland (Prim-ETH) in 
1978 and at Harvard (Prim-H) in 1979-1980. They 
were (and are —Prim-H is in use and still under 
development) similar to Prim-9 in basic computing 
technology and graphical capabilities, though perhaps 
one tenth as expensive. 
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Orion I 


The latest descendant of Prim-9, Orion I, 
represents a substantial advance over the Prim systems, 
at least in hardware. Orion I is both more powerful 
and much less expensive that the Prim systems because 
it takes advantage of advances in microprocessor and 
computer graphics technology in the last decade. 

Orion I cost approximately $60,000 in 1981. It has 
much more computing power than the Prim systems. 
Orion I uses a color graphics device, as opposed to the 
strictly black and white displays in the Prim systems. 
Color is essential for several new methods that are us- 
ed to look at pictures of more than three-dimensional 
data. 

An important implication of Orion I is that such 
graphics systems will soon be widely available. The 
price of systems like Orion I is dropping rapidly; a bet- 
ter system could he build today for $25,000, less than 
half of what it cost eighteen months ago. It is likely 
that in a few years such graphics systems will be in the 
price range of personal computers. 


Applications of Orion I 


The methods we are developing on Orion I em- 
phasize real-time motion and interaction. So it is dif- 
ficult to do them justice in a verbal description. To 
compensate for this, we have made two movies, which 
are available for viewing.*’'° 

Almost any statistical problem will benefit from 
the addition of interactive graphics. An interactive 
graphics system makes it possible to bring human in- 
telligence to bear directly on the problem. Humans 
have powerful abilities for pattern recognition that are 
so far not equaled by computers. Further, a human 
can adapt the analysis to unforeseen features of a data 
set, using judgement and a knowledge of the context 
of the problem from which the data arose. These 
points are clearly illustrated in our two films. 

Orion I is being used to develop interactive 
graphical methods for many statistical problems, in- 
cluding: general multivariate analysis, regression, 
classification, clustering, time series, signal process- 
ing, seismic data (multivariate point processes), and 
analysis of digitized x-rays (interactive image 
processing). 

The first problem, multivariate analysis, refers to 
the analysis of data sets in which there are many 
variables. A typical data set will have 100-1000 obser- 
vations, and for each observation we will have values 
of perhaps 4-20 variables. 

The basic graphical problem posed is this: how 
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can we draw pictures that show us relationships involv- 
ing 4 or more variables at once? If the data set had 
only two variables we would just look at an ordinary 
scatterplot. With three variables we can use a three- 
dimensional scatterplot. Looking at three-dimensional 
pictures is a very natural activity for human beings 
because we live in a three-dimensional world. 
However, drawing pictures that show four or more 
variables and are also easily understood is very 
difficult. 

We are pursuing two basic approaches to more 
than three-dimensional data. The first approach is to 
find ways of effectively representing as many variables 
a possible at once in a single picture. For example, we 
take a three-dimensional scatterplot and color each 
point according to the value of an additional variable. 
This gives us a picture that shows some relationships 
among the four variables. We can add other features 
to the points in the scatterplot, such as size, shape, or 
orientation, to code values of more variables. Each ad- 
ditional feature will, unfortunately, add less informa- 
tion to the picture and will make the picture harder 
to interpret. 

Another method puts several different scatterplots 
on the screen, and uses interactive coloring schemes 
to show relationships between the contents of the 
scatterplots. 

The second approach to many-dimensional data 
is called Projection Pursuit.''’'?’'? The basic idea of 
Projection Pursuit is to compress (or project) the in- 
formation in the many-dimensional data into a two- 
cr three-dimensional picture, which is easy to look at. 
We choose the projection to try to capture any in- 
teresting structure in the many-dimensional data. & 
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Introduction 


here is an increasing concern as to the high 

cost of producing and maintaining weapon 
systems. Current trends indicate that these forces are 
all moving in the wrong direction. Complexity of 
systems are increasing, without improved main- 
tainability considerations to lower the operating costs; 
unit production costs are increasing with ever increas- 
ing maintenance personnel skill levels; availability of 
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skilled personnel is decreasing through lower retention 
of mid-career personnel, while manpower availability 
is decreasing due to past national demographics. Add- 
ed to these individual trends is the interaction and rela- 
tionships they combine to produce. We have lack of 
in personnel and equipment, and we have increasing 
operating costs which reduce our capability to create 
new assets under constrained budgets. We have reduc- 
ed assets, but they are costing us more. Where does 





research in reliability and maintainability (R&M) ir 
teract with these trends, and what can they do to 
reverse these trends? 


The Trends 


The role of R&M in the acquisition process is very 
broad and can have a significant impact on the long 
run operational capability of naval forces. One 
generally thinks of R&M considerations as a method 
for improving equipment operation, but because of the 
interactions between all components of the system, im- 
proving equipment/system R&M has far greater im- 
plications. Consider some of the following 
statistics: The availability of manpower for the re- 
mainder of this century will be 10-25 percent lower 
than we had in 1976. Figure 1 displays the percentage 
change over that 20-year time period. It is interesting 
that the same general picture is true for females, as 
well as males, in the 17-19 year age range. With fewer 
personnel available and a greater demand being plac- 
ed on this population by industry and academic institu- 
tions, the Navy must develop ways to decrease its per- 
sonnel requirements. R&M has potential for doing 
this. 

Figure 2 describes a second consideration—the 
decreasing number of naval aircraft purchases over the 
last 10 years and their average costs. In 1970, we pur- 
chased 134 aircraft for 442 million dollars, while in 
1980, we purchased 39 aircraft for 1,365 million 
dollars—a 400 percent decrease in aircraft; yet, over 
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Figure 1. 


a 300 percent increase in procurement costs. 
Associated with this is an annual maintenance cost that 
averages about 6 percent of its acquisition cost per year 
per aircraft, a second area where R&M can play a 
significant role. 

The increasing complexity of aircraft is well il- 
lustrated by technical manual trends. Figure 3 shows 
the growth of technical manual size over the last 10 
years. This growth is unavoidable in order to provide 
good documentation, but the control, updating, and 
training required is a considerable burden on naval 
resources. This is another area where R&M can play 
a significant role in alleviating present difficulties. 


Weapons Life Cycle 


So far, we have been describing some particular 
areas where improving R&M could be beneficial. How 
do we take advantage of these potential benefits? First, 
we have to understand the long life cycle of a major 
system before we can understand the role R&M plays 
in the acquisition cycle. Figure 4 defines the various 
phases of the acquisition process from definition of 
the need through deployment of the system. To 
understand the time phase in Figure 4, the period to 
deployment is between 10-14 years while the initial 
operating life varies from 15-30 years for aircraft and 
ships, respectively. Together, the acquisition cycle and 
the deployment or operating life represent the life cy- 
cle of the system. The critical decision point is 
Milestone III which is the decision to produce the 
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Figure 2. Declining Navy aircraft purchases. 
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Figure 3. Growth in technical manuals. 
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Figure 4. 


Phases of the acquisition process. 





system. Once the decision is made for production, 
future resources need to be allocated for its operation. 
These resources are of a time-phased nature and can 
be considered as ‘‘flows’’ through the system over a 
multi-year period. 


Acquisition Funds Flow 


Figure 4 is one attempt to describe the Navy 
budget in a very aggregated form with three major 
categories: procurement funds, research and develop- 
ment (R&D) funds, and something called ‘‘cost of 
operating current assets.’’ These categories represent 
the flow of funds into the primary functional areas 
of Navy activity. The flow of funds through the pro- 
curement chain result in accumulated assets. These 
assets are the results of the acquisition process, which 
has a major decision node on the determination of 
force characteristics. R&D funds flow two ways; some 
flow into the force characteristics decision node and 
are used to develop various alternatives- 
characteristics, and to produce prototype systems; and 
some flow into current systems assets through moder- 
nization programs inproving their efficiency and ef- 
fectiveness. The cost of operating current assets flows 
into net ownership costs which provide the resources 
to operate the fleet and shore establishment. The level 
of funds flowing into operations is a major determi- 
nant of the level of naval readiness; that is, if fewer 
funds flow than are required, readiness is lessened. 
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Readiness resources which are needed can be 
defined as the amount of funds required to maintain 
operational commitments including adequate supply 
of technical spare parts; of personnel skills and grades 
for manning; of maintenance funds for ship and air- 
craft overhauls; of training in formal schools, tactics 
and fleet exercises. 

Figure 6 is a more detailed representation of the 
R&D funds flow interactions in the cost of current 
assets area. With an increase or decrease in force 
assets, operational support costs increase or decrease, 
but not proportionally. The relative costs of 
maintenance, operating schedules, and manpower 
affect the degree of change in operation support costs 
as these new assets are acquired. In addition, R&D 
funds are expanded for modernization which should 
reduce the operational costs. 

Each of these areas—maintenance, manpower 
and operations— are candidates for research in R&M. 
They are dependent on each other. Improvements in 
one can have either positive or negative effects on the 
others. Care must be taken to understand what the 
overall influence is on the entire weapon systems life. 
Serious investments to reduce the life cycle cost of 
weapons can have a significant impact on the future 
composition of naval forces. Given Figures 5 and 6, 
consider the following scenario. As the Navy receives 
its budget, a determination is made to fund the cur- 
rent assets account at 100 percent of requirements; the 
remainder of the budget is apportioned at 20 percent 
for R&D and the remainder to procurement. If we 
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translate this to the FY-81 Navy budget, we would 
have something on the order of 23 billion on current 
operations; 4 billion in R&D and 16 billion on pro- 
curement out of a 43 billion dollar total Navy budget. 
A further breakdown of current operations would in- 
clude 16 billion for operations and maintenance and 
7 billion for personnel. If over the next 5 years the 
Navy budget increases by 7 percent and by improving 
R&M related activities, the cost of current operations 
could be held to a 5 percent increase, the distribution 
for FY-86 would be 29 billion for current operations; 
6 billion for R&D, and 23 billion for procurement, out 
of a 58 billion dollar total Navy budget. That two per- 
cent decrease in current operations’ requirements costs 
increases the procurement account by more than 6 per- 
cent. Since current operations costs are such a large 
part of the budget, a small percentage gain can have 
a large influence on the remaining components of the 
budget. While the example shown indicated a decrease 
in current operations, it is also true that an increase 
in current operations costs has a major effect in reduc- 
ing the ability to procure new assets. In fact, the lat- 
ter case is our current difficulty, in that the funds re- 
quired for current operations has been increasing at 
a rate that is seriously eroding the asset base. 
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The Acquisition Cycle 


If we want to interact with the acquisition cycle, 
where are we most effective? Figure 7 describes the 
relationship between product innovation and process 
innovation. Most will agree that product innovation 
is early in the cycle, that technology improvement 
spawns new products which then are considered as 
alternatives to system design. As you move towards 
advanced development where demonstrations, valida- 
tions and cost estimating are completed, new product 
alternatives decrease quickly as full-scale development 
begins and process innovation peaks. There is con- 
siderable concern about process innovation or pro- 
ducibility. It seems that actual practice places that pro- 
cess innovation later in the cycle, which tends to 
lengthen the full-scale development period and causes 
process innovation to peak at the beginning of pro- 
duction. Another way of stating the concern is that 
process innovation is of little concern to the manufac- 
turers until after full-scale development has been com- 
pleted and DSARC III (the decision to move to full 
production) has been approved. 

The ability to influence system characteristics 
must be accomplished early in the cycle. These new 
products are the results of both hardware as well as 
methodology development coming from the 
technology base. They are evaluated and integrated in- 
to the system design during the conceptual effort. 
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While hardware development is important for meeting 
future threats, methodology development has a signifi- 
cant role in attempting to balance the conflicts and 
constraints into the best overall design and life cycle 
operation of the system. 


R&M Areas of Need 


Figure 8 displays several of these conflicts and 
constraints over three primary functional areas for 
system characteristics. The logistics area represents the 
life of the system and its ownership costs after pro- 
curement. Manpower is also a lifetime cost and is 
separated from the more traditional logistics considera- 
tions because of its increasing importance in manning 
systems and the demographics we discussed earlier. 
Aquisition represents those actions and activities that 
are required to bring the system into being. As one 
reflects on the three functional areas, it is obvious that 
they are not independent and actions in one area can 
influence the other areas. 

The particular areas of need are an indication of 
the R&M activity which can influence each of the func- 
tional areas, and as a rough scale. A ‘‘P”’ relates to 
a primary influence while an ‘‘S’’ suggests a secon- 
dary influence. Of those needs displayed, availability 
is the only one considered as having secondary in- 
fluence for manpower and acquisition, yet availabili- 
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ty is not independent of reliability and maintainabili- 
ty. This is especially true when you consider opera- 
tional availability as opposed to supply availability. 
Similar cases can be described for each of the other 
areas, which infer that there are many constraints plac- 
ed on the ‘‘system designer’ before the best affordable 
system can be produced. There are design-to-costs and 
life-cycle considerations, producibility and risk-cost 
tradeoffs and manpower constraints. Consider war- 
ranties; if a new methodology can be developed to im- 
prove our ability to evaluate future cost avoidance due 
to increased reliability/availability early in the acquisi- 
tion phase (before production), direct savings could 
be realized in the logistics and manpower areas dur- 
ing system operating life. Such a methodology should 
contain concepts for rewarding both the Navy (through 
reduced life-cycle cost) and the manufacturers (through 
improved financial incentives during production). This 
would include a reduction in spare parts support; in 
organizational, intermediate and depot maintenance; 
and in training and support personnel at all levels. This 
is especially important for personnel when you con- 
sider that it takes about three inductees to produce one 
E-6 electronics technician. 

Reliability and maintainability considerations are 
important components in the total acquisition process. 
They and their related ‘‘ilities’’ that comprise the 
assurance sciences disciplines, are necessary to provide 
the capability for developing, testing, evaluating and 
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determining the appropriate components and the 
organization of those components into affordable 
systems. 

The increased complexity of weapon systems with 
their highly integrated circuits; their design for prac- 
tical degradation; the need for fault detection and fault 
isolation schemes and applications for quality control, 
optimal inspection scheduling and non-destructive 
testing require increased coordination between the 
Navy, academic and industry to understand the con- 
flicts and constraints and to develop producible and 
affordable systems for our National defense missions. 


Dr. Thomas Varley is Project Director IN- 
TRA Type Tactical Development and Evaluation 
at the Office of Naval Research. His publications 
and research have been primarily in the field of 
operation research and statistics. 
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SRO Program Initiated in 
Inverse Problems 


O ne of ONR’s special programs is the 
Selected Research Opportunity (SRO) Pro- 
gram which selects for special funding research 
areas with great research potential requiring in- 
terdisciplinary approaches. There was a SRO 
program in inverse problems begun in 1983 with 
awards made to research groups at Cornell 
University, Iowa State University, and the 
University of Denver. These three groups were 
selected from approximately fifty groups that 
submitted proposals. 

Inverse problems have long been of interest 
to scientists, engineers and to the Navy. 
However, recent attention to application in 
nondestructive evaluation, oil exploration, and 
medical tomography, as well as the more 
established applications of radar and sonar im- 
aging has led to a greater awareness of and par- 
ticipation in this research field. In addition, re- 
cent and anticipated progress in computational 
capability promises the ability to solve problems 
of increasing difficulty. ONR decided that now 
is the appropriate time to expand research in this 
area to impact on such naval needs as: (1) 
understanding the ocean bottom structure for 
acoustic and seismic wave propagation; (2) im- 
proving reliability via nondestructive testing pro- 
cedures; (3) designing optimum waveform and 
detection algorithms for radar applications; and 
(4) improving sonar techniques for detection and 
classification. 

Although there is evidence of recent 
engineering progress in some inverse problem 
areas, such as computer-aided tomography and 
non-destructive evaluation, this progress has 
been in problem areas in which one has a highly 
controlled environment. This permits the 
achievement of a superior data set both in terms 


of quality and quantity. In other areas, however, 
such as radar classification where the target is 
uncooperative, data sets are much more limited. 
It therefore becomes essential to develop insights 
into the design of systems for collecting and 
analyzing data. Limitations on uniqueness and 
accuracy imposed on the solution by the presence 
of incompleted data must also be investigated. 

It is the purpose of this program to develop 
a better understanding of the fundamentals of 
inverse problems and limitations imposed by 
data collection. There are three cases to be con- 
sidered: (1) too much data (the redundant case) 
for which it is important to understand how to 
most effectively use extra data; (2) insufficient 
data, for which one wants to characterize the 
class of permissible solutions; and (3) sufficient, 
but not redundant data, for which one is in- 
terested in the stability of the solution obtained. 
Progress is especially needed to develop approx- 
imate and qualitative results which will lay the 
foundation for solving two- and three- dimen- 
sional problems. 


(Charles J. Holland, ONR) 


Seminal Work on Quantization 
Published After 19 Years 


The Institute of Electrical and Electronic 
Engineers Transactions on Information Theory 
for March 1982 was issued in two parts. Part 1 
was a Special Issue on Quantization. The 
editorial page for the special issue highlighted Dr. 
Paul Zador’s work as one of the three foci on 
which the issue is based. 

Reference is made to Zador’s 1966 Bell 
Laboratories Memorandum (#18). This is based 
on his Ph.D dissertation which was published as 
Stanford Technical Report 92, December 1963, 
under an Office of Naval Research contract. 
Zador wrote this under Dr. Herbert Solomon but 
unfortunately he did not submit it for 
publication. 
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After he left Bell Labs, all that existed in 
addition to the thesis was the unpublished Bell 
Labs Memorandum of February 1966. When Dr. 
Neil Sloane of Bell Labs visited Stanford a year 
or two ago he mentioned Zador’s work at Bell 
Labs in a seminar talk and said that he was try- 
ing to trace Zador but learned that the Electrical 
Engineering Department had no records of him! 
Dr. Solomon told him that Zador could be found 
at the Insurance Institute for Highway Safety in 
Washington, D.C., and Sloane said that he was 
going to urge Zador to send in a version of his 
work for the IEEE Special Issue. 

Thus, some 19 years had passed before 
Zador’s work made it to print. However, it had 
become a classic technical report and has served 
as a basis for many subsequent developments in 
quantization and coding. The paper, entitled 
‘*Asymptotic Quantization Error of Continuous 
Signals and the Quantization Dimension,’’ was 
published in JEEE Transactions on Information 
Theory, p. 139 to 149. & 


(Edward Wegman, ONR) 


Optimization Applied to Sonar Design 


As a result of an Office of Naval Research 
sponsored workshop on beamforming, a signifi- 
cant application of modern optimization theory 
to a problem of current naval importance will 
be attempted. The workshop was held in April 
1982. Its purpose was to determine whether the 
state-of-the-art of nonlinear optimization was 
sufficiently advanced to have an impact on the 
very large complex models that arise in sonar 
design. 

One of the mathematicians invited to the 
workshop, Professor Leon Lasdon, University 
of Texas at Austin, presented the results of ap- 
proximately 10 years of ONR funding. Under 
this funding, Professor Lasdon has developed 
computer codes using several algorithms, each 
designed for special instances of nonlinear op- 
timization problems. As a result, ONR’s Ad- 
vanced Conformal Submarines Acoustic Sensors 
project has a contract with Professor Lasdon to 
assist in model development and apply these op- 
timization techniques to problems of sonar 
design. 

In addition, ONR has played a small but 
significant role in the development of simi- 
infinite programming in this country. This 
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relatively new field analyzes optimization pro- 
blems where the number of constraints is infinite. 
With additional theoretical development, there 
appear to be important applications of semi- 
infinite programming to sonar design. As a result 
of the workshop, ONR is examining these poten- 
tial applications with the intention of including 
the required basic research in its core program. 
Ly 


(Neal Glassman, ONR) 


Significant New Book on Game Theory 


The Massachusetts Institute of Technology 
Press recently published Game Theory in the 
Social Sciences by Professor Martin Shubik of 
Yale University. On the dust jacket, Anatol 
Rapaport (who is Director of the Institute for 
Advanced Studies in Vienna) calls it a lucid ex- 
position. . . bound to stimulate. . . creative ap- 
plications of game theory in exploring. . . reali- 
ty. Robert Aumann, a leading mathematical 
game theorist, writes that it is ‘‘what the game 
theory world has been waiting for, for the last 
25 years. . . outlines methods and tools of this 
exciting and dynamic field in a way that is com- 
prehensible...to those’ with... little 
mathematical training. It is bound to become a 
classic in a short time.’’ Professor Shubik began 
his long association with the Office of Naval 
Research in the 1950’s when he was a student of 
the late Professor Oskar Morgenstern, coauthor 
with John Von Neumann of Theory of Games 
and Economic Behavior, the book that founded 
game theory. @ 


(J.R. Simpson, ONR) 
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